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® Fault tolerant modular subsystems for computers. 



.®L.A„fault tolerant computing facility which Jncludes 
a housing array for containing a plurality of hardware 
element modules (24) such as disk drives (26), a 
plurality of modularized power supplies (32) and 
plural power distribution modules (40,42), each being 
connected to a separate source of primary facility 
^ power. Each module is self aligning and blind-matea- 
^ble with the housing and may be installed and re- 
moved without tools, without disturbing the electrical 
^cabling within the cabinet, and automatically by a 
0> maintenance robot. The logical identity of each mod- 
-^ule is established by programming at a control panel 
^(16) and by corresponding physical location of in- 
C^stallation of each module within the housing array. 
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FAULT TOLERANT MODULAR SUBSYSTEM FOR COMPUTERS, 



The present invention relates to computing 
systems formed of one or more arrays of intercon- 
nected hardware modules. More particularly, the 
present invention relates to a digital computer sys- 
tem in which its capacity and fault tolerance are 
determined by the number and arrangement of 
modular hardware elements installed in and there- 
by connected in one or more receptacle arrays. 
Robotic installation and removal of modules in the 
environment of the arrays is an aspect of the 
present invention. 

The assignee of the present invention has pio- 
neered the concept of fault tolerance in connection 
with computing system. Basically, that concept 
holds that failure of one element or subsystem of a 
computing system should never be permitted to 
cause the whole system to In practice, the use 
of parallel processors, parallel data paths to periph- 
eral equipment and parallel power supplies has 
resulted in a fault tolerant computing system which 
has significantiy advanced the art This advance is 
document for example, in U.S. Patent No. 
4^8,496, the disclosure of which is incorporated 
herein by reference. 

In practice, discrete hardware elements of a 
computer, such as processors, peripheral device 
controllers, central memory, data mass storage de- 
vices, and power supplies are formed as separate 
hardware elements, and these elements are typi- 
cally interconnected by cabling, and sometimes by 
direct plug in connection to back planes or mother 
boards. 

One commonly encountered hardware element 
is the rotating data storage device, sometimes 
called "disk drive". Disk drives, whether based on 
magnetic or optical storage technologies, are fre- 
quentiy used in computing systems to provide rap- 
ki, random access to stored data. Over the years, 
disk drive technology has progressed to a point 
where a massive amount of data may now be 
stored in a disk drive device using small diameter 
non-removable disks (e.g. eight inch) and having a 
very small physical package. 

Heretofore, the servicing of existing digital 
computer systems, including systems practicing 
fault tolerance, has involved the disconnection of 
cables and hamesses interconnecting the various 
sut}systems such as disk drives. Such servicing 
has typically included the removal and reinstallation 
of cabinetry and mounting hardware. Because of 
the way in which prior computering systems have 
been designed, constructed and assembled, re- 
moval of a circuit board or a cable during servidng 



has either required that aJf primary power to the 
sut)system be removed or has led to failure of 
backup or mirror subsystems, causing a single 
point failure within the computing system. 

5 Also, the manner in which computing systems 

have been assembled has not been conducive of 
automatic maintenance procedures. While industrial 
robots are known and widely employed in industrial 
manufacturing processes, litHe if any effort has 

70 been given to the adaptation of computing systems 
and programmed robotic equipment to facilitate 
automatic maintenance procedures. 

Thus, a hitherto unsolved need has arisen for a 
fault tolerant digital computer incorporating sub- 

75 systems and hardware elements thereof which may 
be serviced, either manually or automatically by 
robotic maintenance equipment, without distur- 
bance of the cabinet and cabling housing and 
connecting the disk drive to be serviced. 

20 A general object of the present invention is to 

provide a fault tolerant computing system formed 
of multiply subsystems of uniform hardware mod- 
ules in one or more interconnecting arrays which 
overcomes the limitations and drawbacks of the 

25 prior art 

In accordance with the present invention, there 
is pnjvided a fault tolerant computing fadlity com- 
prising at least one housing array, characterised 
by: 

30 a plurality of modules, each containing a hardware 
element of said computing facility, 
a plurality of modularized hardware element power 
supplies, there being a separate power supply 
module electrically associated with each said hard- 

3S ware element module, 

at least two separate power distribution modules, 
one power distribution module for distributing pri- 
mary power from a first primary source connection 
to primary modules and power supply modules 

40 associated with primary modules, and a second 
primary source connection to back up mirror mod- 
ules and power supply modules associated with 
back-up mirror modules, and 
interconnect means in said array enabling said 

45 hardware element modules and said power supply 
modules to t>ecome automatically disconnected 
and reconnected when said modules are removed 
and inserted therein. 

A feature of the invention Is to enable the 

50 provision of an array for multiple hardware ele- 

merits su c h a s disk drives which facilitates configu- 

rations of a single string of disk drives or two 
separate strings of disk drives without installation of 
any additional intemal cabling with the array. 
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A further feature of the present invention is to 
enable the provision of improved packaging for 
hardware element of a fault tolerant computing 
system such as a data storage subsystem formed 
of one or more strings of multiple disk drives which 
achieves a significant improvement in serviceability 
and overall system reliability, and which makes the 
subsystem less sensitive to facility power faults. 

Yet another feature of the present invention is 
to enable the provision of a housing for mating with 
hardware attachment carrier modules of a comput- 
ing system in a manner which enables the module 
to be accepted into the housing and thereupon 
automatically connected with power, control and 
data signals, control panel functions and provided 
with cooling without the use of tools and without 
need for access to the cabling installed within the 
cabinet 

A further feature of the present invention is to 
enable the provision of a housing for receiving 
multiple uniformly sized hardware element modules 
and a mating attachment carrier module for each 
hardware element, such as a disk drive, in the form 
of a drawer which is mechanically and electrically 
bfind*mateable with the housing so as not to re- 
quire special adjustment of alignment in order for 
the hardware element it is carrying to be placed in 
tervice. 

One more feature of the present invention is to 
enable the provision of a housing for multiple hard- 
ware element modules which receives a power 
supply for each module in close proximity to the 
modules in order to minimize power supply cabling 
lengths and which enables the supply to be ac- 
cepted into the housing and thereupon automati- 
cally connected to the power distribution cabling of 
the housing without the use of tools and without 
need for access to the cabling installed within the 
housing. 

Yet another feature of the present invention is 
-to enable the provision of a housing, a first primary 
power distribution module (PDM) powered from 
one facility primary power source, and a second 
back-up or mirror image primary PDM powered 
from another primary power source within the fa- 
dlity, with the first PDM supplying power to first 
hardware elements such as disk drives, first pri- 
mary power supplies and one half of the cooling 
apparatus, and with the second PDM supplying 
power to second hardware elements such as back- 
up, mirror image disk drives, back-up power sup- 
plies and the other half of the cooling apparatus, so 
that loss of one facility power buss or circuit break- 
er will not cause the entire subsystem to fail. 



One object of the present invention is to enable 
the provision of a fault tolerant computing system 
facility comprising modularized elements blind- 
mateable with a housing providing all interconnec- 

5 tions so as to enable removal and replacement of - 
each element by one or more programmed robots. 

Thus, a preferred embodiment of a fault toler- 
ant digital computer subsystem In accordance with 
the present invention includes a housing which 

10 includes provisions for receiving a plurality of 
modularized hardware elements, such as disk 
drives for example, including at least one primary 
module and at least one back up mirror module. A 
plurality of modularized power supplies are receiv- 

75 able within the housing, there being a separate 
power supply module electrically associated with 
each separate hardware module. At least two sepa- 
rate power distribution modules (RDM's) are pro- 
vided in the housing. One PDM distributes primary 

20 power from a first facility primary source connec-' 
tton to the primary modules and power supply 
modules associated with primary modules, and one 
half of cooling apparatus in the housing, and a 
second PDM distributes primary power from a sec- 

25 ond facility primary source connection to back up 
mirror modules and power supply modules asso- 
ciated with back up mirror modules and the other 
half of the cooling apparatus within the housing. 
Cabltng within the housing enables the hardware 

30 modules and the power supply modules to be 
mechanically and electrically blind-mateable by 
providing automatic disconnect and reconnect 
when the modules are removed and inserted into 
the cabinet, without the use of tools, either by hand 

35 or by robotic maintenance equipment. 

An electrical configuration arrangement in the 
housing which is cooperatively associated with the 
cabling enables said subsystem to be alternatively 
configured as a single string of hardware modules 

40 and as multiple strings of hardware modules with- 
out physical modification of the internal cabling. 

A control panel is provided for configuring logi- 
cally each module and for indicating condition of 
the hardware modules and power supply modules 

45 installed in the cabinet 

The invention is described further hereinafter, 
by way of example only, with reference to the 
accompanying drawings, in which:- 

Fig. 1 is an orthogonal view of the front side 

50 of one presently preferred eml>odiment of the in- 
vention including a cabinet for receiving multiple 
disk drive and power supply modules. A front door 
has been omitted to facilitate Illustration of the 
cabinet structure. 

-55 H g. 2 is a n-erthegonal-view-Qf-the-back-stde 

of the cabinet depicted in Fig. 1. A rear door has 
been omitted to facilitate illustration. 
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Rg. 3 is an enlarged exploded orthogonal 
view of a drive and drive canier module drawer 
illustrated in Rg. 1 . 

Rg. 4 IS a diagrarn of the logical organization 
of the disk drives and power supply distribution 
connections within the cabinet depicted in Rg. 1 . 

Rg. 5 is a diagram of the extemal data cable 
orientation and connections of the cabinet depicted 
in Rg. 1. 

Rg. 6 is a schematic diagram of extemal 
data cable, jumper and termination connection fa- 
cilftating a single string configuration for the drives 
contained in the cabinet depicted in Rg. 1. 

Rg. 7 is a schematic diagram of external 
data cable and termination connections facilitating 
a two string configuration for the drives contained 
in the cabinet depicted in Rg. 1 , and further illus- 
trating daisy chaining of a plurality of subsystems 
of the type depicted in Rg. 1 . 

Rg. 8 is an orthogonal view of a portion of 
the front side of one bay of a modularized, fault 
tolerant computing fadlity adapted for automatic 
robotic maintenance apparatus and procedures 
comprising a second presently preferred embodi- 
ment of the present invention. 

•fig. 9 is a diagrammatic top plan view of the 
overall computing facility which is partially depicted 
in the orthogonal view of Rg: 8. 

Rg. 10 is a diagrammatic front side view in 
elevation and partial section of the computing fa- 
cility depicted in Rgs. 8 and 9. 



Disk Drive Data Storage Subsystem 1 Q 

A, first preferred embodiment of the present 
invention is Illustrated as a fault tolerant multiple 
disk drive data storage subsystem 10, depicted in 
Rgs. 1 to 7. As seen in Rg. 1, the subsystem 10 is 
illustrated as being contained in a small cabinet 12 
which requires, for example, about six square feet 
of floor space, and stands about three feet in 
height The cabinet 12 includes a top 14, a control 
panel 16 and sidewalls 18. The fc>eveled, transpar- 
ent control panel 16 is secured to the top 14 at the 
front of the cabinet 12. The control panel provides 
for access to configuration controls and acts as a 
window for light emitting signalling devices 17 
which indicate the status of the disk drives installed 
within the cabinet 12. The logical identities of the 
disk drives installed within the cabinet 12 are es- 
tablished by programmable identification plugs 
which may be inserted into and removed from the 
control panel 16. 

Inside the cabinet, shelves 20 and vertica l 



multiple eight-inch disk magnetic media data stor- 
age device having a data storage capacity of 168 
megabytes, unformatted, for example. While mag- 
netic media storage disks are preferred, it is to be 
5 understood that the cabinet and drawer arrange- 
ment may be used effectively with a wide variety of 
hardware elements of a fault tolerant computing 
system. With eight drives 26 installed in the cabi- 
net 12. the subsystem provides an overall data 

10 storage capability of 1.344 gigabytes of unformat- 
ted data. A shelf 28 at the bottom of the cabinet 
12. and vertical dividers 30. define spaces for eight 
plug-in disk drive power supply modules 32. Thus, 
there is a separate power supply module 32 pro- 

15 vided for each disk drive module and each power 
supply module 32 is located in close proximity with 
its associated disk drive module drawer 24. 

A plurality of fans, not shown, are provided on 
a front door of the cabinet 12, also not shown, to 

20 provide a px^rtion of the cooling required to main- 
tain the interior of the cabinet within proper am- 
bient operating range. 

Turning to Rg. 2, each disk drive shelf 20 Is 
provided with an electrical connection backplane 

2S 34. The t^ackplane stmcture 34 includes a connec- 
tor plug 36 for mating with a complementary con- 
nector jack 38 located on the back of the disk drive 
carrier drawer, as seen in Rg. 3. All power, control 
and data connections for the disk drive 26 pass 

30 through the plug 36 and jack 38. as a single 
location of connection. The backplane .structure 34 
includes a horizontal metal support plate 35 and a 
printed circuit connection board 37 having connec- 
tion traces aligned along a rearward edge thereof. 

35 Data cabling, not shown, is provided to connect 
each connection board 37 with an assoaated drive 
jack on a data cable connection plane 44 located at 
the rear of the cabinet 12 and below the shelves 
20. as shown in Rg. 2. Once the data cabling is 

40 connected to each connection board, 
.^electrical/logical configuration of the disk drives 26 
in the cabinet 12 may be made by connections at 
the connection plane 44. 

A primary facility power distribution module 40 

45 is connected to a first source of ladltty primary 
power. The module 40 distributes primary power to 
one half of the power supply modules: for example, 
modules 32A, 32C, 32E and 32G, which are asso- 
ciated with primary drives 26A, 26C. 26E. and 26G. 

so as shown (sic: in) Rg. 4. A mirror facility power 
distribution module 42 is cormected to a second 
source of facility primary power. The module 42 
distributes primary power to the other half of the 
power supply modules: module 32B. 32D. 32F. and 
3 ? H. wh ic h a re associated-wit h mirr or- driv e s 2 6B7— 



dividers 22 are provided to define spaces for eight 
disk drive carrier module drawers 24. Each drawer 
24 contains a disk drive 26, such as a fixed rotating 



26D. 26F. and 26H. 
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It is to be understood that the subsytem 10 
achieves a first level of fault tolerance by providing 
a backup or mirror drive for each primary drive 26. 
Thus, the drive 26B "mirrors'* and backs up the 
drive 26A by containing the same useful data 
therein as is stored in the primary drive. In the 
event of a failure of one source of facility primary 
power, rendering one of the drives 26A or 26B 
inoperative, the other drive, containing a mirror 
image of the data held in the first drive remains on 
line and available for use without interruption in 
computing service. 

Cables 46 facilitate connection of the sub- 
system 10 to two parallel processors of the type 
described in the referenced U.S. Patent No. 
4,228.496. Termination plugs 48 contain suitable 
termination resistances so that the impedances of 
the cables 46 are properly matched and so that 
standing waves do not interfere with high speed 
data and control signal transmissions from the su- 
pervisory parallel processors and the disk drives 
26. 

Details of the disk drive carrier drawer module 
24 are illustrated in Rg. 3. Therein the drawer 24 is 
seen to include two opposite and parallel side rails 
50 having lower longitudinal reinforcing lips 51. A 
front panel 82 is joined to the front ends of the 
opposed side rails 50. The panel defines a rectan- 
gular, opening 53 which facilitates passage of cool- 
ing air currents about the disk drive 26. The panel 
82 also includes provision for a handle 84 and for 
two knuried looking screws 56 which mate with 
corresponding threaded portions at the front of the 
cabinet 12 to lock the drawer 24 in position with 
the cabinet 12. 

Four inset L-shaped brackets 58 are integrally 
formed with the side rails 50. These brackets 58 
define mounting holes which are aligned with 
threaded mounting members of four sidemounted 
shock absorbers 60 of the disk drive 26. The 
^spacing of the side walls 50 and of the brackets 88 
Is such as to accommodate the mounting dimen- 
sions of the disk drive 26. In practice, a disk drive 
model No. M-2322K available from Fujitsu America. 
Inc., 3058 Orchard Drive, San Jose, CA 95134- 
2017, is presently preferred as the implementing 
drive 26. Screws 89 are used to mount the disk 
drive 26 to the drawer 24 at the bracks 58, as 
diagrammed in Fig. 3. 

A transverse fan bracket 62 is mounted by 
screws to the side rails 50 at a location just behind 
the space provided for the drive 26. The bracket 62 
supports a cooling fan 64 which forces cooling air 
currents to pass over the disk drive 26 for carrying 
away heat generated from the spindle motor, ac- 



supply 32 associated with the particular drive. The 
fan bracket Includes an opening 66 for a data and 
control cable which connects the drive 26 and the 
jack 38, and which also provides a second handle 

5 to facilitate lifting of the drawer during installation 
and removal. Side openings 68 are also defined by 
the fan bracket 62, and these openings facilitate 
other connections to the disk drive 62 and also the 
circulation of cooling air currents. 

70 A rear end plate 70 is formed integrally with 

the side rails 50, and the plate includes an upper 
transverse reinforcing lip 72. A machined, precise 
alignment opening 74 is defined through the end 
plate 70 on the right side, as shown in Rg. 3, and a 

75 second, oval alignment opening 76 is formed 
through the left side of the end plate 70. Tapered 
alignment pins extending toward the front of the 
cabinet are provided on the vertical portion of the 
backplane structure 34. These pins enter the open- 

20 ings 74 and 76 and automatically register and align 
the plug 36 and jack 38 prior to engagement there- 
of as the drawer 24 is slid along the shelf, until the 
plug and jack mate as the drawer 24 reaches its 
installation position within the cabinet 12. Then, the 

25 screws 56 are rotated manually to secure the draw- 
er 24 in place. 

It will be understood from Rgs.. 4-7 that the 
logical and electrical identification of each disk 
drive 26 is established by the physical location of 

30 the disk drive within the cabinet 12. Thus, as seen 
from the front, the upper right drive 26A, the first 
primary drive, is mirrored by the drive 26B just 
below it. The next primary drive 26C is mirrored by 
the drive 260 iat the lower right. The upper left third 

35 primary drive 26E is mirrored by its back up drive 
26F, and the. fourth primary drive 26G is mirrored 
by its back up drive 26H at the lower left. 

The control panel 16 is arranged as shown in 
Rg. 4 so that an indicator display 17 is associated 

40 with each drive 26. Thus, the indicator display 17A 
displays the status of the drive 26A, display 17B 
displays the status of the drive 26B, display 17C 
displays the status of the drive 26C. display 17D 
displays the status of the drive 26D, display 17E 

4S displays the status of the drive 26E, display 17F 
displays the status of the drive 26F. display 17G 
displays the status of the drive 26G, and display 
17H displays the status of the drive 26H. 

Each disk drive 26 is provided with two data 

50 connectors on the data cable connector plane 44 
as shown schematically in Rg. 5. This dual con- 
nection arrangement facilitates connection of each 
drive 26 to two disk drive controllers of the fault 
tolerant parallel processing system to which the 

55 subsystem 10 is connected. If one controller or its 



tuator motor and electronics of the disk drive. The 
fan 64 is connected to the facility distributio mod- 
ule 40 or 42 which supplies power to the power 



cabling fails in service, the other controller remains 
on line, thereby providing fault tolerance of the 
overall system. 
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Jumper cables 47 and terminations 48 enable 
the subsystem to be configured as a single daisy* 
chained array of storage devices as shown in Rg. 
6. The term "daisy-chain" as used herein is syn- 
onymous in meaning with par^ line, broadcast 
mode or unibus and means that a disk drive con- 
troller broadcasts each control message to aJI of 
the disk drives of the chain even though the mes- 
sage is intended only for one of them. The particu- 
lar disk drive 26 for which the message is intended 
recognizes the message and responds to the con- 
troller, also typically via a common communication 
path. Other connection arrangements, such as pri- 
vate lines between each disk drive 26 and the 
controller are within the pun/iew of the present 
invention. 

Alternative connections, showrt in Rg. 7 enable 
the subsystem 10 to be multipie daisy-chained 
internally, and in connection to two other like sub- 
systems 10' and 10*. 



Modular Fault Tolerant Computing Facility 100 

A fault tolerant computing facility 100 employ- 
ing the concept of standardized electrically and 
mechanically blind-mateabie carrier module draw- 
ers, such as the drawer 24 depicted and previously 
discussed in conjunction with the subsystem 10, is 
illustrated in Rgs. 8-10. Therein, the facility is ar- 
ranged into a group of four spaced apart, generally 
parallel equipment arrays or bays 102, a portion of 
one being shown in Rg. 8. The facility 100 pro 
vides for a computing system which may be ex- 
panded in virtually unlimited fashion, and also pro- 
vides for and factiitates use of automatic robotic 
maintenance procedures and equipment. While the 
drawers 24- described in connection with the sub- 
system 10 are depicted in Rg. 8, it is to be 
understood that a hardware element other tinan a 

-disk drive may be mounted in a particular drawer. 
For example, one drawer may include a central 
processor, another may include a peripheral pro- 
cessor, a third may include a device controller, a 
fourth may include central memory, and so forth. 

As with the subsystem 10, each bay of the 
facility 100 provides an array of shelves 120 and 
vertical dividers 122 which define unifonn spaces 
for the drawers 24. However, there is no require- 
ment that the spaces be uniform, so long as they 
are accessible from a major side of each array 102. 
And, there is no constraint on the length of a 
particular t>ay 102. and a bay could be extended to 
any practical length in any dimension, remember- 

-in g that th e p r act ic al co n st ra i n ts ar e direct acces s" 



to modules and cables and cable lengths between 
computing elements which limit the speeds at 
which control signals and data may be passed 
back and forth. 

5 Shelves 128 and vertical dividers 130 are pro- 

vided for e.g. four power supply modules 32 di- 
rectly under each column of four spaces for the 
module drawers 24. Each power supply location is 
associated with a particular space for a drawer, so 

70 as to keep power supply cable lengtiis as short as 
practicable. 

One arrangement of the facility is depicted in 
Rg. 9 wherein e.g. four parallel, spaced apart bays 
102 are closely spaced from a back plane array 

15 104 arranged normal to each bay. With this ar- 
rangement cables 106 from each bay 102 may be 
plugged into and interconnected within the back 
plane array 104. The back plane array 104 may 
include monitoring apparatus and controls which 

20 are accessible to an operator at a control panel 116 
along an outer wall 108. 

Each array or bay 102 is mounted on a suit- 
able pedestal 110 so tfiat the spaces Jqr modules 
and power supplies are elevated a suitable dis- 

25 tance, from the floor 112. The bays 102 and the 
back plane array 104 may be enclosed by a top 
wall 114, side walls 116, and a back wall 118 in 
order to define a forced air plenum for cooling the 
fecility 1 00. 

30 Cooling fans such as e.g. a pusher fan 140 and 

a puller fan 142 may be provided to move coolmg 
air currents through the plenum and the bays 102 
in order to draw off heat generated by the hard- 
ware elements within the module drawers 24 and 

35 the power supplies 32. While only two fans are 
illustrated, it Is apparent that any number of cooling 
elements, whether air or liquid, and whether asso- 
ciated with the entire facility or with each one or a 
few adjacent drawers of a bay may be employed, it 

40 being remembered that one important concept of 
fault tolerance in computing systems is the avoid- 
ance of any single point of failure of the computing 
facility 100. 

In accordance with an important aspect of the 
45 present invention, an industrial robot 150 is pro- 
vided for maintenance, installation and/or reconfig- 
uration procedures within the facility 100. The robot 
150 may follow a variety of forms and be of any 
suitable structure. Its purpose is to be able to 
50 remove and replace any drawer 24. power supply 
32 or cable 106 within the facility, automatically 
and without human operator intervention. One suit- 
able form of robot 180 grossly resembles a remote 
controlled (by low powered local radio signals) foric 
&5 Hft and includes a platform 152 earned by a oattery 
powered wheel carriage having wheels 154 which 
engage tracks 156 extending throughout the facility 
100 at locations which give ttie robot 150 precise 
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access to each space for every drawer 24 and 
power supply module 32. A vertical rack 158 en- 
ables a horizontal table 160 to move vertically 
between the spaces of a column of the array 102. 
The table 160 may be pnavided with a general or 
specific gripping mechanism 162 to enable the 
robot 180 to grasp each drawer 24 or power supply 
32. Once the mechanism 162 has engaged e.g. the 
front panel 52 of a drawer 24, then the table 160 Is 
translated horizontally in order to draw the drawer 
24 from its space in the array. 

The robot 150 then transports the drawer 24 
and its hardware elements contents to a suitable 
service area 164 where a replacement drawer 24 is 
available. The robot 1 50 deposits the drawer it just 
removed into a pick up area for a service techni- 
cian, picks up the replacement drawer 24, returns 
to the particular space of the bay 102 from which 
the original drawer was removed and inserts and 
moves the new drawer 24 into the space until it 
becomes mechanically engaged and electrically 
connected in the manner previously described in 
connection with the subsystem 10. 

The robot 180 is also provided with cable grip- 
ping equipment for removing and replacing each of 
the cables 106 under program control. 

Doors or other suitable closures or strips 166 
may be provided in the back wall 1 1 8 in the vicinity 
of the tracks 156 so that a forced air plenum 
arrangement is maintained while still providing ac- 
cess for the robot 180 to each of the arrays 102. 

A locating system Is provided for the robot 180 
within the facility 100. One suitable indexing ar- 
rangements may be a scale 168 along the base 
110 of each anay 102. The scale 168 may be two 
dimensional and read optically by suitable optical 
sensors in the robot 150, or may be three dimen- 
sional and be read by electromechanical cam fol- 
lowing equipment. Each drawer 24 is preferably 
provided with a unique bar code, such as a Univer- 
sal Product Code, in a standard arrangement and 
location. An optical scanning device aboard the 
robot 1 50 may then scan the bar code to verify that 
the correct module is being removed for service. 

The robot 150 operates automatically under 
program control. A special computer may be pro- 
vided for the robot 150, or the computing facility 
100 may include special service routines as part of 
its resources management in order to make effec- 
tive use of the robot In any event, the robot 
maintenance service program maintains a facilities 
resource map which records the precise location of 
each robotically accessible hardware element v^th- 
in the facility 100 and correlates an identifying 
lumbe r of each m eduleT-powef-suppiy-aftd-cabte 
(preferably recorded on the bar code affixed to the 
particular element) with its present location. When 



e.g. a module 24 is replaced, the identifying num- 
ber of the replacement module is substituted in the 
facilities map automatically during executipn of the 
service program. 
5 While tracks 1 56 are shown, painted lines may 

also be provided and followed by a steerable robot 
having suitable optional sensors for following the 
lines. 

To those skilled in the art to which the present 
70 invention pertains many changes in construction 
and widely variant embodiments will be suggested 
without departure from the scope of the present 
invention as defined by the appended claims. 
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Claims 

1 . A fault tolerant computing facility comprising 
at least one housing anray, characterised by: 

a plurality of modules (24), each containing a hard- 
ware element (26) of said computing facility, 
a plurality of modularized hardware element power 
supplies (32), there being a separate power supply 
module (32) eiectrically associated with each said 
hardware element module (26). 
at least two separate power distribution modules 
(40.42), one power distribution module (40) for dis- 
tributing primary power from a first primary source 
connection to primary modules and power supply 
modules associated with primary modules, and a 
second primary source connection to back-up mir- 
ror modules and power supply modules associated 
with back-up mirror modules, and 
interconnect means in said array enabling said 
hardware element modules and said power supply 
modules to become automatically disconnected 
and reconnected when said modules are removed 
and inserted therein. 

2. A computing facility as claimed in claim 1. 
further comprising at least two separate cooling 
means for cooling said hardware element modules 
and said power supply modules, and wherein said 
one power distribution module connects to one of 
said cooling means and wherein said second pow- 
er distribution module connects to said other of 
said cooling means. 

3. A computing facility as claimed in claim 1 or 
2, further comprising electrical configuration 
means, in said array and co-operatively associated 
with said interconnect means for enabling said ar- 
ray to t>e alternatively configured without physical 
modification of internal cabling as one of: a single 
string of hardware element modules; and multiple 
strings of hardware element modules. 

ting facility as cicumed claim 17~ 
or 3, wherein each said hardware element module 
includes alignment means complementary with 
said array for mechanically aligning said module 
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with said array so that saicf module is biind-matea- 
ble with said array and said interconnect means 
thereof. 

5. A computing facility as claimed in any of 
claims 1 to 4, further comprising control panel s 
means for indicating condit'ons of hardware ele- 
ment modules and power supply modules installed 

in said array. 

6. A computing facility as claimed in claim 5, 
wherein said control panel means indudes sepa- ro 
rate indicating means for indicating the condition of 

a particular module with which it is associated. 

7. A computing facility as claimed In claim 1. 
wherein said housing array and said interconnect 
means automatically provide power, control and 7S 
data signals and cooling for each said hardware 
element module upon installation into said array. 

8. A computing facility as claimed in claim 1, 
wherein said hardware element modules may be 
installed and removed from said array without 20 
tools. 

9.. A computing facility as claimed in claim t, 
wherein said hardware element modules, power 
supply modules and interconnect means externally 
connecting to said array may be installed and 25 
removed automatically by robot. 

to. A computing fadlity as claimed in any of 
claims 1 to 9, wherein said housing array com- 
prises internally an arrangement of shelves and 
wherein each said hardware element module is of 
dimensions compatible with a said shelf and com- 
prises a carrier drawer for slidafaly engaging the 
said shelf of said array and induding connecting 
means for connecting the hardware element of said 
module with said interconnect means assodated 
with the said shelf at a single location of connec- 
tion. 

1 1. A computing facility as daimed in claim 5, 
wherein the logical identity of a said module is 
determined by programmable identification means 40 
on said control panel and by position of placement 

of each said module within said array. 

12. A computing fadlity as claimed in any of 
claims 1 to 11, wherein said array further com- 
prises a data cable connector plane accessible 45 
directly from the outside for enabling data connec- 
tion cables to be attached to said array, said data 
cable connector plane including a plurality of data 
jacks in electrical connection with module positions 

of said cabinet assodated therewith. 50 

13. A computing facility as claimed in claim 1, 
wherein said plurality of modules includes at least 
one primary module and at least one back-up mir- 
ror module for containing the same data as is 
stored in a said primary drive associated therewith. 55 
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14. A computing fadlity as claimed in claim 1. 
wherein said array comprises a rotating fixed disk 
data storage subsystem and wherein each module 
thereof is associafied with a disk drive. 

15. A fault tolerant computing facility compris- 
ing at least one housing array, characterised by: 

a plurality of modules uniformly aligned in the 
array, each module containing a hardware element 
of said computing fadlity. and at least one spare 
hardware element module, 

interconnect means in said array enabling said 
hardware element modules to become automati- 
cally disconnected and reconnected within said fa- 
cility when said modules are removed and inserted 
therein. 

robot means (150) within said fadlity having direct 
access for removal of a said module and replace- 
ment thereof with said spare hardware element 
module within said array under automatic control of 
a fadlity maintenance computing element of said 
fadlity. 



8 



0 242 970 




0 242 970 




0 242 970 





S 


DATA 3-P 


S 


DATA l-P 


-I7A 


I7F-- 


$ 


DATA 3-H 


S 


DATA l-M 


-I7B 


176- 


S 


DATA 4-P 


s 


DATA 2-P 


-I7C 


I7H- 


S 


DATA 4-N 


s 


DATA Z'H 


^170 



_ CONTROL 
PANEL 16 



S DATA 3-P -26E 



SDATA l-P 



s DATA 3-N -aep 



SDATA l-N 



S DATA 4-P -266 



S DATA 2-P 



'26A 
>26B 
^26C 



SDATA4-M -26H 



J[f32Er32F]f326£32H |£32A£32Bj£32M20 



I 



I 



S DATA 2-N -260 



POM I 
(PRIMARY) Uq 



PDM 2 
(MIRROR) 



D 



-DRIVES 26 



"1 POWER 
h- SUPPLIES 

J ^ 

~1 PWRDIST 
HMOOULES 
42 J 40.42 



26A-_ 
26B-> 
26C- 
26D-{ 



] [ 



] 



'6* 



'-26E 
)-26F 
1^266 
26H 



1 

I z 



\r^T vf vf vr 



IN 



12 12 12 

' 16| 

OUT IN 



OUT I 



CONTROL 



•44 



.DRIVES 
26 



-HA387- 



-T0TI6 P/P 



. CABLE 
BULKHEAD 



_»A3OT J[»TiP^<P__ 

FIG.«5. 



-TYP 



I 



0 242 970 




0 2K970 




0 242 970 




0 242 970 




® 



Europalsches Patentamt 
European Patent Office 
Office europeen des brevets 



© Publication number: 



0 242 970 

A3 



® 



EUROPEAN PATENT APPLICATION 



® Application number: 87302192.7 
@ Date of filing: 13.0a87 



® Int. ci/»: G06F 1/00 , G06F 11/20 



@ Priority: 18.04.86 US 853537 

@ Date of publication of application: 
2ai 0.87 Bulletin 87/44 

@ Designated Contracting States: 
DE FR GB IT SE 

@ Date of deferred publication of the search report: 
05.07.89 Bulletin 89/27 



® Applicant: TANDEM COMPUTERS 
INCORPORATED 
19333 Valico Parkway 
Cupertino California 9501 4(US) 

® Inventor: Varaiya, Rooshabh 
22237 Cupertino Road 
Cupertino, California 95014(US) 
Inventor: Ng, David S. 
12085 Manila Drive 
Saratoga California 95070<US) 
Inventor: Pauker, Armando 
939 Azure Street,3 Sunnyvale 
California 94087(US) 
Inventor: Ferchau, Jeorg U. 
17044 Shady Lane Drive 
Morgan Hill California 95307(US) 

0 Representative: Huntingford, David Ian et al 
W.P. THOMPSON & CO. Coopers Building 
Church Street 
Uverpooi LI 3AB(GB) 



® Fault tolerant modular subsystems for computers. 

© A fault tolerant computing facility which includes 
a housing array for containing a plurality of hardware 
element modules (24) such as disk drives (26), a 
plurality of modularized power supplies (32) and 
^plural power distribution modules (40,42), each being 
^connected to a separate source of primary facility 
power. Each module is self aligning and blind-matea- 
j^ble with the housing and may be installed and re- 
O moved without tools, without disturbing the electrical 
^cabling within the cabinet and automatically by a 
^maintenance robot The logical identity of each mod- 
CM tile is established by programming at a control panel 
gj(16) and by conresponding physical location of in- 
^ stallation of e ach module within the housing array. 

Ill 




Xerox Copy Centf e 



EP 0 242 970 A3 




la 



J 



European Patent 
OfRce 



EUROPEAN SEARCH REPORT 



Application Number 



EP 87 30 2192 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Y 
Y 



Citation of document «vitb indication, where appropriate, 
of relevant passages 



US-A-3 691 432 (EDFORS et al.) 

* Abstract; column 2, lines 40-59; 
column 5, lines 22-41; figures 3.7 * 

* Abstract * 

PATENT ABSTRACTS OF JAPAN, vol. 8. no 
79 (P-267)[15163, Hth April .1984; & 
JP-A-50 222 354 (NIPPON DENKI K.K.) 
24-12-1983 

* Whole abstract * 

PATENT ABSTRACTS OF JAPAN, vol. 7, no. 
192 (P-218)[1337], 23rd August 1983; & 
JP-A-58 90 224 (NIPPON DENKI K.K.) 
28-05-1983 

* Whole abstract * 

EP-A-0 083 422 (IBM) 

* Page 4, line 32 - page 5, line 20; 
figure 1 * 

COMPUTER SYSTEMS, vol.. 5, no. 6, June 
1985, pages 47-48,51, Bromley, GB; D. 
TAYLOR: "Failsafe computing" 

* Pages 47,48 * 

ADVANCES IN INSTRUMENTATION, vol. 28. 
no. 2, October 1973, pages 1-6, ISA,' 
AC, Pittsburgh, US; D.C. GRIFFITH et 
al. : "Considerations in U.P.S. systems 
for computerized energy centers" 

* Abstract; page 2, column 1, lines 
45-58; column 2, lines 55-66 * 



The present search report has been drawn up for alt claims 



Flacaof 

THE HAGUE 



Date of Goiiq>letion of the search 

31-03-1989 



Relevant 
to claim 



1-14 



15 
15 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant if taken alone 

Y ; particHlarly relevant If cnmblncd with-anotfaei^ 

document of the same category 
A : technological background 
O : non-written disclosure 
P : intermediate document 



CLASSIFICATION OF THE 
APPUCATION (Int. a.4) 



G 06 F 11/00 
G 05 F 11/20 



TECHNICAL HELDS 
SEARCHED am. a.4) 



G 06 F 
G 11 C 
G 05 B 



Eieamiiier 

COHEN B. 



T : theojy or principle underlying the invention 
E : earlier patent document, but published on, or 
after the filing date 

iiocttment-c i ted iu the applicat i on 



document cited for other reasons 



& : member of the same patent family, correspondTng' 

document 



This Page is Inserted by IFW Indexing and Scanning 
Operations and is not part of the Official Record 



Defective images within this document are accurate representations of the original 
documents submitted by the applicant. 

Defects in the images include but are not limited to the items checked: 



Lr BLACK BORDERS 

□ IMAGE CUT OFF AT TOP, BOTTOM OR SmES 

□ FADED TEXT OR DRAWING 

□ BLURRED OR ILLEGIBLE TEXT OR DRAWING 

□ SKEWED/SLANTED IMAGES 

□ COLOR OR BLACK AND WHITE PHOTOGRAPHS 

□ GRAY SCALE DOCUMENTS 



□ LINES OR MARKS ON ORIGINAL DOCUMENT 

□ REFERENCE(S) OR EXHIBIT(S) SUBMITTED ARE POOR QUALITY 

□ OTHER: 



IMAGES ARE BEST AVAILABLE COPY. 
As rescanning these documents will not correct the image 
problems checked, please do not report these problems to 
the IFW Image Problem Mailbox. 



BEST AVAILABLE IMAGES 




